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Abstract — A three terminal relay system with binary erasure 
channel (BEC) was considered, in which a source forwarded 
information to a destination with a relay's "assistance". The 
nested LDGM (Low-density generator-matrix) -LDPC (low- 
density parity-check) was designed to realize Compress-and- 
forward (CF) at the relay. LDGM coding compressed the received 
signals losslessly and LDPC realized the binning for Slepian-Wolf 
coding. Firstly a practical coding scheme was proposed to achieve 
the cut-set bound on the capacity of the system, employing 
LDPC and Nested LDGM-LDPC codes at the source and relay 
respectively. Then, the degree distribution of LDGM and LDPC 
codes was optimized with a given rate bound, which ensured that 
the iterative belief propagation (BP) decoding algorithm at the 
destination was convergent. Finally, simulations results show that 
the performance achieved based on nested codes is very close to 
Slepian-Wolf theoretical limit. 

Index Terms — Slepian-Wolf source coding, Nested LDGM- 
LDPC, Compress-and-Forward, BEC, Relay channel. 



I. Introduction 

COOPERATIVE communication III has recently attracted 
much attention due to it can achieve a larger rate 
region, compared with traditional networks. Many coopera- 
tive protocols have been proposed in the literature. These 
protocols are usually classified into three categories: decode- 
and-forward (DF) protocol, where the relay decodes and re- 
encodes the signals transmitted by the source; amplify-and- 
forward (AF) protocol, in which a relay simply amplifies its 
received signals; compress-and-forward (CF) protocol, where 
the relay compresses the signals from the source, and forwards 
these compressed soft information to the destination. For DF 
protocol, it has been widely researched based on LDPC codes 
||2l, and suffers a loss of performance when the relay can't be 
guaranteed to recover the source information. The relay always 
can assist the source to convey information with amplified soft 
information when AF protocol is employed, but the protocol 
is suboptimal. CF protocol, jointing source-channel coding, 
is a form of Wyner-Ziv (WZ) coding [3] in case of lossy 
compression and Slepian-Wolf coding ||4l in the lossless case. 
It takes advantages of the statistical dependence of the relay's 
and destination's channel output, and achieves higher rate than 
DF and AF. 

So far, most of the researches concerning CF remain at the 
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theoretical level and the realization of CF is tackled in only 
a few papers, |l6l Q. These papers achieve Slepian-Wolf 
compression at the relay by taking the syndrome of an LDPC 
code |5|, or by using an Irregular Repeat Accumulator (IRA) 
code |6| that combines Slepian-Wolf coding with channel 
coding on the relay-to-destination channel. However these 
approaches are suitable only when the source-relay channel 
output is binary and the relay does lossless (rather than lossy) 
compression. Otherwise, e.g. the Gaussian relay channel is 
considered in f?!, significant capacity losses will result. 

It is known that LDPC codes are good channel codes and 
recent work has also shown that LDGM codes are good source 
codes. Some near-ideal encoding/decoding algorithms with 
LDGM codes have been proposed |8| |9|, furthermore nested 
LDGM-LDPC codes often are used to guarantee both channel 
coding and source coding performance. In |10|, such nested 
codes are used to approach capacity in dirty paper coding, 
where good channel coding ensures low error probability and 
good source coding guarantees good shaping of the transmitted 
signal. 

To focus on the effective compression of the received data 
at the relay, we consider a three terminal cooperative system 
where the source-destination and source-relay links are both 
binary erasure channel (BEC), and the relay-destination link is 
orthogonal to them. As the received signal by the relay through 
the BEC is 3-ary, the aforementioned syndrome methods are 
insufficient, making the proposed nested codes necessary. 

This paper is organized as follows. Section II gives a brief 
introduction to the system model involving a relay channel. 
Section III describes the compression and decoding algorithms 
based on nested LDGM-LDPC codes. Section IV presents 
the degree distribution optimization method necessary for 
good performance. Experiment results are given in Section 
V to verify the effectiveness of the proposed algorithms and 
optimization methods. Finally, Section VI concludes the paper. 

II. SYSTEM MODEL 

The full-duplex single relay system is shown in Fig.l. 
It comprises a source S, a destination D and a relay node 
R. The S-R and S-D links, both with erasure probability e, 
form a binary erasure broadcast channel. The R-D link, with 
a capacity denoted by Crd, is orthogonal to the S-D and 
S-R links. Denoting an erased bit by E, the relay system 
is described by four random variables x^, Xr, Vr, Vd and 
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Fig. 1. The single relay system 



one conditional probability distribution p(yr, |/d|a:^s ), which is 
shown in Table I. 

TABLE I 

Conditional PROBABILITY DISTRIBUTION OF p(j/r,j/ii|3;s = 0), When 

p{yr,yd\Xa = 1), THE VARIABLES VALUE: AND 1 EXCHANGE 
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In every block a message w which is random variable uni- 
formly distributed on [1, 2"^) is encoded into sequence Xg = 
{xsi,Xs2, ■ ■ ■ ,Xsn) at the source S, and transmitted through 

BEC. yr = {yrl,yr2, - ■ ■ ,yrn), Vd = {Vdl , yd2, ' ' ' , Vdn) 

is received by R and D respectively. At R yr is decoded 
or loselessly compressed, and then re-encoded into Xr = 
{xri,Xr2, ■ ■ ■ , Xrn') to implement DF or CF respectively. 
When Crd is sufficiently large, could be decoded with the 
compressed signals Xr and the side information yd- w could 
be recovered at D by jointly decoding yr and ya- Then the 
achievable rate fill of the system is given by 

1) If is decoded, then 

R<I{xs;yr\xr) = l-e (1) 

2) If yr is compressed and encoded into Xr, with large Crd 
the compression can be lossless, in which case 

R<Iixs;yryd)^l-e^ (2) 

It can be seen from (1) that, when Crd is large, the S-R link 
become the bottleneck of DF mode. However CF can achieve 
a higher rate in (2), which is actually the cut-set bound [H] 
on the capacity of the relay channel. On the other hand, in 
CF mode the relay node is unable to decode yr , so the Crd 
must be large enough to transmit all the information about the 
erased positions. 

In this paper, we focus on lossless CF, and since it already 
achieves capacity, the remaining task is to minimize Crd the 
necessary. As yd is available at D and is correlated with yr, it 
can be used as side information to reduce y^'s encoding rate 
from H{yr) into H{yr\yd) through Slepian-Wolf coding. In 
the next section, nested LDGM-LDPC codes will be designed 
to realize the compression and binning necessary for Slepian- 
Wolf coding. 

III. The nested LDGM-LDPC code for compression 

Considering that LDPC as channel code achieves capacity- 
approaching performance with low-complexity iterative decod- 
ing manner, we encode the source messages with an LDPC 




Fig. 2. The LDPC code Ci 



code, denoted by factor graph lfT2l Ci, which is shown in 
Fig. 2. The circles denote the variable nodes q, representing n 
bits codeword of LDPC codes, and the black squares denote 
the check (function) nodes s, representing k parity check 
equations. The number of edges connected to one node is 
denoted as the degree of the node. The rate i?o = ^^^^ 
could approach cut-set bound in (2) by optimizing the degree 
distribution of Ci , which will is discussed in the next section. 

With Ci the message it; at S is encoded into a binary 
sequence Xg G {0,1}" and transmitted over BEC. Then 
the received sequence y^ by R is relayed to D via CF. We 
design a nested LDGM-LDPC construction C2, to deal with 
the compression problem at R, whose factor graph is shown 
in Fig. 3. The circles are also the variable nodes and black 
squares are the factor nodes. As each is regarded as a ternary 
symbol, we firstly map y^ into a binary sequence c by 

y„ = V3(c2i-1 ® V2i-1 © C2j-l,C2i ® V2i © C,2i) , 

^(00) = 0, (^(01) = 1, ^(1*) = i 1, 2, • • • , n, (3) 

Where * denotes "don't care" positions that can be encoded 
into either or L t; is a pseudo-random dither sequence which 
is added to assure uniform distribution. C, is normally an all- 
zero sequence, but in practice erroneous decimation of the 
b-nodes will inevitably occur and cause contradictions, which 
must be corrected by flipping the bits in corresponding to the 
c-nodes with contradictions. Here the factor nodes connected 
to yr and c represent the mapping in (3). Then with LDGM 
part of C2 , the binary sequence containing * is quantized into 
a shorter one b by 

c = 6G,fe e {0,l}",m = (4) 

where G is the generation matrix and i?b is optimized to be 
slightly larger than 2 — e , so that LDGM coding with i?b is 
lossless. After that, we use the LDPC part of G2 to compress 
b into p, with 

p = {0, = (5) 

where H is the sparse parity check matrix and Rp also 
optimized is slightly larger than H{yr\yd)- H{yr\yd) is the 
Slepian-Wolf theoretical limit. 

Until now the nested LDGM-LDPC code has been used to 
compress y^ into p (as well as the flipped positions Q at the 
rate approximately equal to H{yr\yd)- Assuming that Crd is 
sufficient for transmitting these information, D can decode y^ 
from the side information y^ and the compressed information 
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Fig. 3. The nested LDGM-LDPC codes C2 



p losslessly. The iterative belief propagation |fT3l decoding 
process is also executed from Fig. 3. Finally, combining 
with Dd, D recovers the message w, again by the BP algorithm. 

IV. Code Optimization Ci and C2 

When LDPC, LDGM and nested codes are designed, it is 
always critical to optimize the degree distributions so that 
BP converges well, which can be visualized on the EXIT 
chart IIT4I as a gap. So we optimize the degree distribution 
using the EXIT and EBP curve (Extended BP curve which 
is another form of EXIT chart) [15| considering both the 
encoding process and decoding process also from the source 
node, relay node and destination node. 

The design of Ci involves just LDPC optimization over 
a BEC with erasure probability , which means that the 
prior information at q-nodes acquired from channel output 
becomes Iq^pri = 1 — S-regular, q-irregular LDPC code 
lfT3l is designed to achieve good performance. Let ds be the 
left-degree of all s-nodes, and denote Vqd as the fraction of 
edges connected to q-nodes with the right-degree d. Iqs, Igq 
represent the average mutual information (MI) in every q-to- 
s, s-to-q message at a certain iteration respectively. Then the 
optimization the degree distribution Vqd of q-nodes is a linear 
programming problem, which is 



maxRo = 
s.t.y^^Vqd 



1 



1/4 



Ed ^qd/d 
Ij Iqs > Iqs' 



Aq^Isq e [0,1] 



in which 



/gs = 1 - (1 - Iq.pn) ^ Vqd{l - I sqY 



{Isq) 



(6) 



(7) 



(8) 



where superscript "-" refers to last iteration. EXIT curves at 
q-nodes and s-nodes called q-curve and s-curve are given by 
(7) and (8). A^s is added to ensure that there are some gap 
between the matched EXIT curves, so that BP algorithm won't 
get stuck. 

For the nested LDGM-LDPC code C2, the LDGM pait 
is essentially dictated by good encoder-side performance at 
the relay node, so we optimize it first. As Ternary symbol 



Dri is encoded into two bits C2i-i,C2i in c-nodes, to simplify 
analysis, we assume all b-nodes have the left-degree di, and 
the two bits C2i_i,C2i connected to the same j/ri-node have the 
same right-degree, called the c-degree of the t/^-node. Now 
we only have to optimize the c-degree distribution of the yr- 
nodes, represented by Vcd, the fraction of edges connected to 
j/r-nodes with c-degree d from the edge perspective. Besides, 
the optimization is needed with the constraint of the monotonic 
condition [9|, which makes sure that encoding can proceed 
with a vanishing fraction of contradictions and thus flipped 
bits. Thus the optimization problem is summarized as 

2 

mini?;, = 



s.t.y^^vcd 



in which 



db Ed'"cd/d 

— 1 7 ^hc.pri I /(jc 



.o>0,^^>0,/,ee[0,i] 



dl, 



be 



(1 - Ibc)/{1 - IcbY 



Icb — lyc J2d '"cdihcY ^ 



(9) 



(10) 



(11) 



Where Ibc, Icb denotes the average MI in every b-to-c, c-to-b 
message at a certain iteration respectively, and lyc — 1 — O.Se 
represents the priors average MI of the -nodes with c-degree, 
which is acquired from the mapping in (3). Ibc,pri denotes the 
priors average MI of the b-nodes at fixed points(i.e. Ibc,pri 
making the average MI Ibc = ^b^), and it should be when 
Ibc = and increase monotonically as Ibc increase from to 
L 

With the degree distribution of LDGM part fixed, we opti- 
mize the degree distribution of the LDPC part of C2 to achieve 
decoder-side performance. During the iterative decoding of 
Ur at the destination, the average MI of the message from 
yr- to c-nodes, denoted as lyc.d for those with c-degree d, 
varies between /co = I{c\yd) and 1^ = I{c2i-i;ydt\c2i) + 
I{c2u ydi\c2i-i), according to the incoming messages from c- 
and -nodes, that is 



lycA - Ica{l - Ibc) + ^cllbc 

Making Icb in (H) become 

Icb — Vcdlyc,d{lbc)'^^^ 



(12) 



(13) 



Let Ibc,ext denote the extrinsic MI of b-node at fixed points, 
derived only from Icb, which is 



bc.ext 



1 - (1 - Icbf' 



(14) 



Thus the decoder-side EBP curve of the LDGM part formed by 
Ibc,pri VS. Ibc,ext IS derived from (10) and (14). The LDPC part 
is designed to make the EBP curve of LDPC part Ibp,pri vs. 
Ibp,ext match that of LDGM part, so that t/r can be decoded. 
In other words, suppose the EBP curve is plotted with Ibp,ext 
in the horizontal axis and Ibc,ext in the vertical axis, then EBP 
curve of the LDPC part should lie below that of the LDGM 
part, with a small gap between them. The gap assures that 
iterative decoding does not get stuck. Thus let Vpd and Vbd 
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denotes the fraction of edges connected to p-node and b-node 
with the left-degree and right-degree d respectively. The degree 
distributions are optimized to achieve the minimal rate, which 
is 



min Rp = Rb — Rbp = Rj, — {1 — 

S.t.^Vpd = l,^Vbd 
d d 

Ihp,ext — 1 



Ed Vpd/d 

J2dVbd/d 



l,Ipb> hb+ ^pb,Ipb € [0,1] 



J2'""i{'i- - ipb)" 



^bc,pri — -^bp,ext-;-^bp,pri ^bc.ext 

Ibp = I — {I — Ibp,pri) Vbd{^ — ipbY' 



iib = Y.''p<iihpr 



(15) 




Fig. 4. The EBP curve of nested LDGM-LDPC codes in C2 witli gap at 
destination node 



Where hcext is derived from the EBP curve of LDGM part 
at the decoder-side with the corresponding Ibc,pri known. Ibp, 
Ipb denotes the average MI in every b-to-p, p-to-b message 
at a certain iteration respectively, and superscript "+" refers 
to the next iteration. Apb is designed to keep the gap in the 
EBP curves of the LDGM and LDPC part to make the BP 
converge. 

V. Numerical Results 

In this section we evaluate the performance of our optimiza- 
tion for degree distribution and LDGM-LDPC encoding and 
decoding process. Let the erasure probabilities of the S-R and 
S-D links be £ = 0.5, the R-D link be ideal with Crd at least 
1.25 bit/sym, and the block length n = 10^. Since the cut-set 
bound in (2) is I{xs; ydUd) = 0.75 bit/sym, the code rate of 
Ci is i?o < 0.75 bit/sym. The degree distribution of Ci is 
optimized to achieve the maximal rate Rq. With 2 — s = 1.5 
bit/sym and H{yr\yd) = 1-25 bit/sym, the nested code C2 has 
i?6 > 1.5 bit/sym, Rp > 1.25 bit/sym. 

Optimizing the degree distribution of LDPC code by (6) 
with Iq,pri = 0.75, ds = 16, Rq = 0.742 is acquired, and the 
optimized degree distribution Vqd is shown in Table II. With 
db = 6, lyc = 0.75, the degree distribution of LDGM part 
of C2 is optimized by (9), and Rb — 1.5019 is acquired. The 
optimized degree distribution Vcd of LDGM part at encoding 
side is represented in Table III. 

TABLE II 

The degree distribution of LDPC code Ci at the source 



that of LDGM part and both of them match well, which assure 
that the iterative BP algorithm converge. 

With optimized degree distribution of Ci and C2, the 
simulation of encoding and decoding processes is executed. 
The experiment result shows that the iteration count of BP 
decoding the LDGM part in C2 is about 200, and LDPC 
decoding in destination is only about 150. However, when 
erasure probability e decreases, which denotes the channel 
capacity increases, the iteration count will decrease. With 
Monte Carlo simulation. The BER performance at destination 
node for relay system in BEC under CP and DF is shown in 
Table V. Simulation shows that under CF the BER is about 
10^ in most blocks, and some blocks even recover source 
information correctly, which sees that CF is much better than 
DF (i? < 0.5, by only optimizing the degree distribution of Ci 
to realize DF). Besides, Rq = 0.472 is close to CF theoretical 
Umit 0.75. 

Some remarks on the design of Ci and C2 are in order. 



TABLE III 

The degree distribution iicd of LDGM part in C2 
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TABLE IV 

The degree distribution ind.fpd of LDPC part in C2 
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With Ico = 0.0472 and = 0.2028, The EBP curve of 
LDGM part at the decoder- side is shown in the dashed curve 
of Fig.4. Then by (15), Rp = 1.2696 is acquired and the 
optimized degree distributions Vpd, Vbd of LDPC part at the 
decoder-side is shown in Table IV. The EBP curve of LDPC 
part is shown in the solid curve of Fig.4 with some gap. It can 
be seen that The EBP curve of LDPC part indeed lies below 
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TABLE V 

BER performance at destination: BEC channel; single-relay 

system 
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Firstly, when the degree distribution of LDPC in Ci and 
LDGM in C2 is optimized, the degree of s-nodes and b- 
nodes should be chosen carefully. Here reasonable choice of 
ds ranges from 16 to 20 and di, — 6. Secondly, we should 
leave a uniform gap between the EXIT curves of LDPC codes 
in Ci and between EBP curves of the LDGM and LDPC parts 
in C2 to make iterative decoding converge with a reasonable 
number of iterations rather than getting stuck. Besides, in order 
not to cut down the designed rate, we need assure the gap Ags 
and Apb should not be larger than 0.01 in every iteration. E.g. 
this gap of the EBP curves of the nested LDGM-LDPC part 
in C2 is designed with Apt— 0.004, which is shown in Fig.4. 
The decoding process of yr will not get stuck and with the 
flipped position known in the destination, could be decoded 
correctly. 

Thirdly, there will inevitably be some incorrect decimation 
in the LDGM quantization process, which cause contradictions 
that must be corrected by flipping some bits in Q. This ^ 
must also be transmitted to the destination using a fraction 
of Crd, so that it can perform decoding correctly. We found 
that the number of flipped positions is about 600, and Rp is 
1.2696bit/sym, so we require Crd = Rp + 2 * (600/2 * 
10^) = 1.8385 bit/sym (here i?2b) = P^og^p + (1 - 
p)log2(l — p))- We could see that even with the flipped 
positions transmitted the required channel capacity Crd of R- 
D link can still be lower than H{yr) — 1.5 bit/sym. In our 
future work, we will study the lossy compression of y^, so 
that we can get lower Crd- 

It is also observed that the performance of the proposed 
practical CF scheme improves as the block length increases at 
the cost of larger memory consumption and coding delay. 

VI. CONCLUSION 

In this paper, a first practical CF scheme for a type of relay 
system based on nested LDGM-LDPC has been proposed, and 
methods for optimizing the degree distributions have been 
described. Simulation results show that the nested LDGM- 
LDPC codes can perform Slepian-Wolf compression of the 
relay's ternary received signals when the relay system is BEC. 
The performance of our scheme approaches the CF theoretical 
cut-set bound, while previous schemes are either limited to 
binary signals or suboptimal. Our work shows nested LDGM- 
LDPC codes for practical CF scheme is sufficient. 

It is apparently straightforward to extend the proposed 
scheme to realize lossy compression, which would offer better 
performance achieved at a lower relay-destination channel 
capacity . The design will be considered in our future work. 
We will also try to optimize the gap between the BEP curves 
of the LDGM and LDPC parts of the nested code, so that its 
decoding can converge more quickly and reliably. 
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